Search results for "Kullback symmetric divergence"

showing 2 items of 2 documents

SCORING ALTERNATIVE FORECAST DISTRIBUTIONS: COMPLETING THE KULLBACK DISTANCE COMPLEX

2018

We develop two surprising new results regarding the use of proper scoring rules for evaluating the predictive quality of two alternative sequential forecast distributions. Both of the proponents prefer to be awarded a score derived from the other's distribution rather than a score awarded on the basis of their own. A Pareto optimal exchange of their scoring outcomes provides the basis for a comparison of forecast quality that is preferred by both forecasters, and also evades a feature of arbitrariness inherent in using the forecasters' own achieved scores. The well-known Kullback divergence, used as a measure of information, is evaluated via the entropies in the two forecast distributions a…

Settore MAT/06 - Probabilita' E Statistica MatematicaProbability (math.PR)Mathematics - Statistics TheoryStatistics Theory (math.ST)PARETO OPTIMAL EXCHANGETOTAL LOGARITHMIC SCORING RULEKULLBACK SYMMETRIC DIVERGENCEPREVISIONENTROPY/EXTROPYSettore SECS-S/06 -Metodi Mat. dell'Economia e d. Scienze Attuariali e Finanz.FOS: MathematicsMathematics - ProbabilityCROSS ENTROPYBREGMAN DIVERGENCE
researchProduct

The Duality of Entropy/Extropy, and Completion of the Kullback Information Complex

2018

The refinement axiom for entropy has been provocative in providing foundations of information theory, recognised as thoughtworthy in the writings of both Shannon and Jaynes. A resolution to their concerns has been provided recently by the discovery that the entropy measure of a probability distribution has a dual measure, a complementary companion designated as &ldquo

Kullback–Leibler divergenceSettore MAT/06 - Probabilita' E Statistica MatematicaLogarithmGeneral Physics and Astronomylcsh:Astrophysics02 engineering and technologyBregman divergenceMathematical proofInformation theory01 natural sciencesArticle010104 statistics & probabilityFermi–Dirac entropyKullback symmetric divergencelcsh:QB460-4660202 electrical engineering electronic engineering information engineeringEntropy (information theory)0101 mathematicslcsh:Sciencerelative entropy/extropyAxiomMathematics020206 networking & telecommunicationslcsh:QC1-999total logarithmic scoring ruleProbability distributiondualityPareto optimal exchangelcsh:QprevisionextropySettore SECS-S/01 - StatisticaentropyMathematical economicslcsh:PhysicsEntropy
researchProduct